What is claimed is: 

1 . A computer program product for enhancing performance of a multithreaded application, 
said computer program product embodied on a computer-readable medium and comprising: 
computer-readable program code means for executing a plurality of worker threads; 
computer-readable program cJde means for receiving a plurality of incoming client 



inconir 



requests for connections onto an incoming queue; 

computer-readable program cod^ means for transferring each of said received client 
requests for connections from said incoming queue to a wide queue, said wide queue comprising a 



plurality of queues wherein each of said queues is separately synchronization-protected; and 

computer-readable program code means for servicing, by said plurality of worker threads, 
said client requests by retrieving selected on^s of said client requests from said wide queue. 



2. The computer program product according to Claim 1, wherein said computer-readable 
program code means for transferring further comprises: 



on a selected one of said plurality of queues using a Wst-In, First-Out (FIFO) strategy, wherein 



computer-readable program code means for placing each of said received client requests 

sine a^irst-I 

said selected one of said plurality of queues is selected using a round-robin approach; and further 
comprising: \ 

computer-readable program code means for returning said retrieved selected ones of said 
client requests to said wide queue using said FIFO strategy^ind said round-robin approach upon 
completion of said computer-readable program code means for servicing. 
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3. A computer program product for enhancing performance of a multithreaded application, 
said computer program product embodied on a computer-readable medium and comprising: 

computer-readable program code means for executing a plurality of worker threads; 
computer-readable program code means for receiving a plurality of incoming client 
requests onto a queue, wherein each of said client requests is for a connection to a host; 

computer-readable program code means for retrieving, by individual ones of said worker 
threads, a selected one of said client requests from said queue; 

computer-readable program code means for determining a number of connections to said 
host to which said connection is requested in said selected client request, wherein said number are 
those which are currently assigned to one or more of said worker threads; 

computer-readable program coda means for processing said selected client request if said 
number is less than an upper limit, and fonnot processing said selected client request otherwise; 
and \ 

computer-readable program code means for returning said processed client request or said 
not processed client request to said queue. \ 

4. The computer program product according to Claim 3, wherein said upper limit is a 
system-wide value. \ 

5. The computer program product according to Claim 3, wherein said upper limit is a value 
specific to said host to which said connection is requested. 
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1 6. The computer program product according to Claim 5, wherein said value is dynamically 

2 computed, and further comprising: 

3 computer-readable program code means for executing a supervisor thread; 

4 computer-readable program code means for monitoring, by said supervisor thread, 

5 whether connections to each of said hosts succeed or fail; and 

6 computer-readable program cone means for decrementing said value when said 

7 connections to said host fail. \ 

7. The computer program product according to Claim 6, further comprising: 
Ml computer-readable program code means for incrementing said value when said 

3p connections to said host succeed. \ 

h% 8. The computer program product according to Claim 6, wherein said computer-readable 

y § \ 

2|J program code means for monitoring further comprises: 

33 computer-readable program code means for Vetting, by each of said worker threads, a 

4 thread time stamp when said worker thread performs active work; 

5 computer-readable program code means for comparing, by said supervisor thread, said 

6 thread time stamp for each of said worker threads to a system time, thereby computing an elapsed 

7 time for said worker thread; and \ 

8 computer-readable program code means for deactivating said worker thread if said elapsed 

9 time exceeds a maximum allowable time. \ 



RSW9-2000-0036-US1 



-27- 



9. The computer program product according to Claim 3, further comprising: 
computer-readable program code means for providing information for each of said hosts, 

said information comprising an address of said host and a plurality of in-use flags; 

computer-readable program code means for setting a selected one of said in-use flags 
when a particular worker thread isWocessing work on said connection to a particular host, 
wherein said selected one of said inVuse flags is associated with said particular worker thread; and 

computer-readable program code means for resetting said selected one of said in-use flags 
when said particular worker thread s^ops processing work on said connection to said particular 
host; and 

wherein said computer-readablA program code means for determining said number of 
currently-assigned connections further comprises computer-readable program code means for 
counting how many of said in-use flags arAset. 

10. The computer program product according to Claim 3, wherein said queue is a wide queue 
comprised of a plurality of First-In, First-Out (FIFO) queues. 

11. A system for enhancing performance of a multithreaded application, comprising: 
means for executing a plurality of worker threads; 

means for receiving a plurality of incoming cliept requests for connections onto an 
incoming queue; 

means for transferring each of said received clienArequests for connections from said 
incoming queue to a wide queue, said wide queue comprising a plurality of queues wherein each 
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7 of said queues is separately syncntonization-protected; and 

8 means for servicing, by said plurality of worker threads, said client requests by retrieving 

9 selected ones of said client requests from said wide queue. 

1 12. The system according to Claim 11, wherein said means for transferring further comprises: 

2 means for placing each of said received client requests on a selected one of said plurality 

3 of queues using a First-In, First-Out (FIFO) strategy, wherein said selected one of said plurality of 

4 queues is selected using a round-robin approach; and further comprising: 

53 means for returning said retrieved selected ones of said client requests to said wide queue 

&l using said FIFO strategy and said round-robin approach upon completion of said means for 

An \ 

|j serving. \ 

D V\ U y. A system for enhancing performance of a multithreaded application, comprising: 
|^ means for executing a plurality of worker threads; 

means for receiving a plurality of incoming client requests onto a queue, wherein each of 

4 said client requests is for a connection to a host; \ 

5 means for retrieving, by individual ones of said worker threads, a selected one of said 

6 client requests from said queue; \ 

7 means for determining a number of connections to said host to which said connection is 

8 requested in said selected client request, wherein said number are those which are currently 

9 assigned to one or more of said worker threads; \ 

10 means for processing said selected client request if said number is less than an upper limit, 
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1 1 and for not processing said selected client request otherwise; and 

12 means for returning said processed client request or said not processed client request to 

13 said queue. \ 

1 14. The system according to Claim 13, wherein said upper limit is a system-wide value. 

1 15. The system according to Claim 13, wherein said upper limit is a value specific to said host 

2 to which said connection is requested. \ 

C? \ 

Wl 16. The system according to Claim 15, wherein sJud value is dynamically computed, and 

2f : further comprising: \ 

$J* y / means for executing a supervisor thread; \ 

4a Riv *X means for monitoring, by said supervisor thread, whether connections to each of said hosts 

$U v succeed or fail; and \ 

means for decrementing said value when said connections to said host fail. 

1 17. The system according to Claim 16, further comprising: \ 

2 means for incrementing said value when said connections to said host succeed. 

1 18. The system according to Claim 16, wherein said means for monitoring further comprises: 

2 means for setting, by each of said worker threads, a threadltime stamp when said worker 

3 thread performs active work; \ 
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means for comparing, by said^upervisor thread, said thread time stamp for each of said 
worker threads to a system time, thereby computing an elapsed time for said worker thread; and 

means for deactivating said worker thread if said elapsed time exceeds a maximum 
allowable time. 



19. The system according to Claim 13, farther comprising: 

means for providing information for each of said hosts, said information comprising an 
address of said host and a plurality of in-use fkgs; 

means for setting a selected one of saialin-use flags when a particular worker thread is 
processing work on said connection to a particular host, wherein said selected one of said in-use 
flags is associated with said particular worker thread; and 
y / means for resetting said selected one of sa\d in-use flags when said particular worker 
ead stops processing work on said connection tb said particular host; and 

wherein said means for determining said number of currently-assigned connections further 
comprises means for counting how many of said in-use flags are set. 



20. The system according to Claim 13, wherein saiq queue is a wide queue comprised of a 
plurality of First-In, First-Out (FIFO) queues. 

21 . A method for enhancing performance of a multithreaded application, comprising the steps 

of: 

executing a plurality of worker threads; 



RSW9-2000-0036-US1 



-31 



\ 

receiving a plurality of incoming client requests for connections onto an incoming queue; 
transferring each of said received client requests for connections from said incoming queue 
to a wide queue, said wide queue comprising a plurality of queues wherein each of said queues is 
separately synchronization-protected; and 

servicing, by said plurality of worker threads, said client requests by retrieving selected 
ones of said client requests from said wide queue. 

22. The method according to Claim 21, \vherein said transferring step further comprises the 
steps of: 

placing each of said received client requests on a selected one of said plurality of queues 
using a First-In, First-Out (FIFO) strategy, wherein said selected one of said plurality of queues is 
\ selected using a round-robin approach; and further comprising the step of: 
j returning said retrieved selected ones of s^d client requests to said wide queue using said 

J FIFO strategy and said round-robin approach upon\;ompletion of said servicing step. 

23. A method for enhancing performance of a multithreaded application, comprising the steps 
of: 

executing a plurality of worker threads; 

receiving a plurality of incoming client requests ontfy a queue, wherein each of said client 
requests is for a connection to a host; 

retrieving, by individual ones of said worker threads, \ selected one of said client requests 
from said queue; 
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8 determining a number of connections to said host to which said connection is requested m 

9 said selected client request, wherein said number are those which are currently assigned to one or 

10 more of said worker threads; \^ 

1 1 processing said selected client request if said number is less than an upper limit, and not 

12 processing said selected client request otherwise; and 

13 returning said processed client request or said not processed client request to said queue. 

1 24. The method according to Claim 23, wherein said upper limit is a system-wide value. 

Iji 25. The method according to Claim 23, wherein said upper limit is a value specific to said host 
to which said connection is requested. \ 

jh 26. The method according to Claim 25, wherein said value is dynamically computed, and 

Ijj further comprising the steps of: \ 
33 executing a supervisor thread; \ 

4 monitoring, by said supervisor thread, whether connections to each of said hosts succeed 

5 or fail; and \ 

6 decrementing said value when said connections to said host fail. 

1 27. The method according to Claim 26, further comprising me step of incrementing said value 

2 when said connections to said host succeed. 1 
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28. The method according to Claim 26, wherein said monitoring step further comprises the 

\ 

steps of: 

setting, by each of said worker threads, a thread time stamp when said worker thread 
performs active work; 

comparing, by said supervisor thread, said thread time stamp for each of said worker 
threads to a system time, thereby computing an elapsed time for said worker thread; and 

deactivating said worker thread if said elapsed time exceeds a maximum allowable time. 



29. The method according to Claim 23, further Comprising the steps of: 

providing information for each of said hosts, Sjaid information comprising an address of 
said host and a plurality of in-use flags; 

setting a selected one of said in-use flags when\a particular worker thread is processing 
work on said connection to a particular host, wherein s^id selected one of said in-use flags is 
associated with said particular worker thread; and 

resetting said selected one of said in-use flags wh&i said particular worker thread stops 
processing work on said connection to said particular hostA and 

wherein said step of determining said number of currently-assigned connections further 
comprises counting how many of said in-use flags are set. 



30. The method according to Claim 23, wherein said queue isy wide queue comprised of a 
plurality of Eirst-In, First-Out (FIFO) queues. 
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